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Abstract 

We investigate the problem of estimating the product of means of indepen- 
dent populations from the one parameter exponential family in a Bayesian 
framework. We give a random design which allocates rrii the number of obser- 
vations from population Pi such that the Bayes risk associated with squared 
error loss and cost per unit observation is as small as possible. The design is 
shown to be asymptotically optimal. 

Keywords: Two stage design, Exponential family, Bayes risk. Cost, 

Asymptotic optimality. 

2000 MSG: 62L05, 62L12, 62C05 



1. Introduction 

Assume that for i = l,...,n] a random variable Xi whose distribution 
belongs to the one parameter exponential family is observable from popu- 
lation Pi with cost Cj per unit observation. The problem of interest is to 
estimate the product of means using a Bayesian approach associated with 
squared error loss and cost. Since a Bayesian framework is considered, cf. 
[l, lij, then typically optimal estimators are Bayesian estimators and the 



problem turns to design a sequential allocation scheme, cf. [10|, to select 
rrii the number of observations from population Pj such that the Bayes risk 
plus the corresponding budget B = Yl^=i ^i^i as small as possible. In jej, 
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a sequential design was defined to estimate the difference between means of 
two populations from the exponential family with associated cost. The ran- 
dom allocation was shown to be the best from numerical considerations, cf. 
0, Isl, |9[. Similarly, the problem of estimating the product of several means 
of independent populations, subject to the constraint of a total number of 
observations M fixed, was addressed in ^ using a two stage approach. The 
allocation of rrii was nonrandom and the first order optimality was shown for 
large M, cf. 0,3. 

Suppose that has the distribution of the form 

where f2 is a bounded open interval in M. It follows that Eg. [xi] = ip' {9i) 
and Vare^ [xi] = ip" {9i) . Our aim is to estimate the product 

n 

1=1 

subject to squared error loss and cost. One assumes that prior distribution 
for each 6i is given by 

„ri/ii6»i-T-ii/)(0i) 

TT,; (9^ 



where and /Xj are reals and > 0, i = 1, n. Here we treat 9i as a realiza- 
tion of a random variable and assume that for each population, Xji, 
are conditionally independent and that 9i, ...,9n are a priori independent. 

2. The Bayes risk 

Posterior distributions of 9i are given by 

grm;/imj6'i-rmjl/'(0i) 

TTi {9i/Xi) = TTi {9i/Xii, ...,Ximi) 



In e^'^i^"^i^^~'''"^i^^^^^ d9i 
where = + and 

Enii 
_ I i=l 



2 



Let us denote by J-mi,...,m„ the a-Field generated by (Xi,...,X„) where 
Xi = {xii, ...,Xim,) and let J^rn, = cr i^i) = a {xn, ...,XimJ- It was shown in 
Isl that 



Var[tlj'{e,)/J^m,] = E 



'/J'mi 



IJli + Ti 

Using independence across populations, the Bayes estimator of 6 is 



(1) 
(2) 



1=1 



Hence, the posterior expected loss is 



/ (mi, ...,m„) = E 



,4 = 1 



-E' 



i=l 



and with the help of independence, equations ([T]), ([2]) and the fact that 

^2 {e,) I7rn\ = Var (6,) jj^^ - E [^'^ (^,) / J-„,J 
one can write 



n 



I (mi, m„) = J] E (^,) / - J] E 



i=l 



i=l 



n I* 



12 I 



rrii + Ti 



/ ^m\,...,mn 



E 



i=l 



mi, ...,171', 



rrii + Ti 



where F is an algebraic sum of terms Cki,k2 with Cki,k2 is a product of fci 
terms from the sequence ( ^ ^'-^ ) and ^2 terms from the sequence 

V / i=\,...,n 

if^ (^i)),=i ... n' ^1 > 2 and fci + A;2 = n. 



One assumes that there exists p > 1 such that 
E[{ij"m'] <+oo andE[(^'(^^,)) 



2p 



< +00 



(3) 
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for alH = 1, ...,n; then the corresponding Bayes risk associated with loss and 
cost can be written as 



R{mi, ...,mn) = E 



n jj 



^=l + r=l 



Ciini 



and by the way, approximated for large samples by 



R{P)^R{mi,...,mn)^E 



^ rrii + ri ^ 

1=1 1=1 



CitTli 



where t/,^, = E [l^i/J-^,,...,^J and = V" (^^) 11 V'" {Oj) 



3. Lower bound for the scaled Bayes risk 

Theorem 1. For any policy P, the following inequality holds: 



R{P) 



> 2E 



E 

i=l 



-E 



i=l 



Proof. The proof is a direct consequence of the following inequality: 



+ CiUli 



rrii + r 



+ Ci {rrii + Ti) - CiTi 



V^i + r., 

> "^yfCiyJUirxii ~ Cifi- 

From now on, the notation c ^ means that Cj — >■ 0, for all j = 1, n. 
Furthermore, assume that for all i, 

^ Ai e]0,l[, as c^O. 
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Theorem 2. For any random design P, 



liminf-^i2= > 2E 

c^O j n 



i=l 



Proof. Theorem ([T]) and Fatou's lemma give immediately 



liminf-?i2= > 2E 

c->0 

'E 9 

i=i 



lim inf > 

c-s>0 



i=l 



\ 



2E 



1=1 



Theorem 3. For any design satisfying 

miy/ci — > ttj 7^ , a.e., as c — )■ 0; 

then 



lim inf _^i£L = lim inf _^i£L > 



E 9 



Proof. Since 



R{P) 



lim inf 

c— >0 ; n 



lim inf 



^(P) 



+ lim 



im — , of — 

^0 / n ^ V m 



c->-0 / n c-s>0 ; n — ' \ m,; 



and 



lim — ;^^= o ( — 

Ec, 



lim > 



i=l 



1 

mi 



then the proof follows. 
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4. First order optimal design 

We look for designs satisfying 

R{P) 



-2E 



So, we write 



1=1 



^0, as c^O. 



-2E 



i=l 



2E 



.2=1 



E 

i=l 



n 



-E 



i=l 



Hence, sufficient conditions for a such design to be asymptotically converg 
are: 



2E 



i 



n 

Ecj 



-2E 



,i=l 







E 



/ n 

{m + J Y.^ Cj 



0, Vi 



as c ^ 0. 
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Theorem 4. Let P a random policy satisfying rrii — > +00, a.e. Suppose that 
condition ^ is true, then 



E 



i=l 



Proof. Remark that 



-E 



i=l 



0, as c -> 0. 



hm ^/Uim.^ 

mi,...,m„->+oo 



Vi, a.e. 



Now 



sup E 

mi,...,m„ 



sup E [Ui, 

mi,...,m„ 



E 
E 



< 



(6) 



hence, the uniform integrability of \/Vimi follows from condition (|3]) and 
martingales properties. Therefore, the convergence in (j6]) holds in and 
consequently : 



-^—\/Ui^^ \f^i^i in L^, as c 0, 
£9 



which achieves the proof. 



5. The two stage procedure 

Following the previous section, our strategy now is to satisfy condition 
([5]) as c —J- 0. Then, we define the two stage sequential scheme as follows. 

Stage one proceed for hi observation from population Pi for i = 
such that kiy/ci — )■ and ki — )• +00 as q — )■ 0. 
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Stage two select integer as follows : 

rrii = max {ki, rhi} 

where 



rrii 



and 



Uiki = E 



We give now the main result of the paper: 

Theorem 5. Assume condition ^ satisfied for ap>l, then the two stage 
design is first order optimal. 

Proof. The rrii, as defined by the two stage, satisfies 



lim {rrii + ^Jci = \/Vi 



and since 



^Cj{mi + ri) 



d {rrii + ri) PV] 

== ^ V V ^ ~^ 0' 

~5r^ — V -^i 



then : 



{\/Uvm, - {rrii + Ti) y/c^y 
Cj {rrii + Ti) 



— )■ 0, a.e., as c — 



(7) 



To show the convergence in L^, it will be sufficient to show the uniform 
integrability of the left hand side of ([7]). 
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Now, observe that: 



J2 Cj {rui + Ti) 



< 



< 



Uirn.A 



+ {rrii + Ti) 



Ci 



n 



ihi 



and the uniform integrabihty will be established if one shows that UimJ \/Uiki 
and \/Uiki are both uniformly integrable. So, ^^/Uit^ is uniformly integrable 
as a result of martingales LP convergence properties with p — 2. To prove 
the uniform integrabihty of UimJ \fU^i remark that 



= < max\/C/i^ 



iki 



and for the remainder of the proof, we use Doob's inequality to show that 



E 



max \/Uik' 

. k' 



< +00 



We have. 



E 



max 

k 



2p 



< 



2p 



2p-l 



2p 



E 



2p 



< +00 



hence, since p > 1, max^/ yUik' is integrable and the proof follows. 



6. Conclusion 

The proof of the first order asymptotic optimality for the two stage design 
has been obtained mainly through an adequate scaling of the approximated 
Bayes risk associated with squared error loss and cost, a lower bound for 
the scaled Bayes risk independent of allocation, martingales properties and 
Doob's inequality. 
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